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A METHOD FOR RECOVERING 3D SCENE STRUCTURE AND CAMERA 
MOTION DIRECTLY FROM IMAGE INTENSITIES 

ABSTRACT OF THE INVENTION 
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^^^C^ ^ The pre)^ invention is directed to a method for recovering 3D scene 
10 structure and camera moti\from image data obtained from a multi-image sequence, 

wherein a reference image of\ie sequence is taken by a camera at a reference perspective 
and one or more successive im^es of the sequence are taken at one or more successive 
different perspectives by translating and/or rotating the camera, the method comprising 
The steps of determining image dam shifts for each successive image with respect to the 
15 reference image; the shifts being deAved from the camera translation and/or rotation from 
the reference perspective to the successive different perspectives; 
constructing a shift data matrix that inlorporates the image data shifts for each image; 
calculating a rank-1 factorizations fronlthe shift data matrix using SVD, with one of the 
rank-1 factors being a vector corresponJng to the 3D structure and the other rank-1 
20 factor being a vector corresponding to thi size of the camera motions; dividing the 

successive images into smoothing windows; recovering the direction of camera motion 
from the first vector corresponding to the iD structure by solving a linear equation; and 



recovering the 3D structure by solving a li 



25 projection matrix; recovering camera rotai 



icar equation using the recovered camera 



motion. In accordance with the present intention, the method includes computing afirst 



Ion vectors from the shift data matrix, and the 



first projection matrix; computing a second projection matrix; and recovering the 
direction of camera translation using the siiift data matrix, the reference image, the 
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second projection matrix andihe recovered camera rotation vectors. In addition the 
method includes recovering tlffi 3D structure from the shift data matrix, the reference 
image, the recovered camera rotation vectors and the recovered direction of franslation 
vectors. 
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